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ABSTRACT 

The development of a checklist for use in monitoring 
and evaluating the quality of child care services, and the 
implications r: use of the checklist by day care providers, are 
discussed. Several research studies that used the indicator checklist 
model have attempted to determine whether compliance with state child 
care regulations has a positive impact on children and whether 
predictors of program quality can be identified. Findings have 
revealed that centers with low compliance scores have the lowest 
program quality scores; centers in substantial compliance have the 
highest program quality scores; and centers in full compliance have 
sraewhat lower program quality scores than centers in substantial 
c<»iipliance. Regulatory and program quality items that correlated with 
program compliance and quality, including items related to effective 
administration, implementation of a child development curriculum, and 
parent participation, were identified. These results could have an 
impact on public day care policy related to day care regulation and 
monitoring, states can emphasise substantial compliance with the 
predictor and indicator items of the indicator checklist model. Two 
advantages of the model are that its use can: (l) reduce state costs 
for monitoring and licensing day care centers; and (2) save centers 
time. A list of child development program quality indicators is 
provided in Figure 2. (RH) 
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AEBIRACI 

A chm care reffOatory, ■onltoring and evaluation siyBteoB BOdel 
Mvwged a cooaortlia (Children's Servicee Monitoring Tranafer 
ConBomi»-Ca«J) of aevaral states Is deaoni)ed. nis vdel, entitled the 
iadioator ctaecklist statistical Mdel, is laaed iqion a oonoept of ' 
identiyng Indicators/predictors of dagr care pro^m qoaUly and 
wafUtoty ooi^llanoe that have a positive impact on children's dsvelonBanc 
Mhile in cut-of -tee care. Besearch conducted ly the OSHC is piuimiLiidtJiUi 
ge yUcatioM of this research ftor state's child care deUvST^^ten. 
AdjwntaaBB of tiie indicator checklist statistical aodel as it r^ates to 
pflOlo policy are presented, along with reccmendations to state dar car« 
agancy auiiiiistrators. 
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Cie concern for evaluating child dsQr care services grew out of tiie 
Initial studies on dagr care as an intervention to ameliorate child 
developoeat d^idta in children fron lov income fafflilies. These early dag- 
care evaluations (lezar, Darlington, Morragr, Royce and Snipper, 1961; 
¥el]cart, Bond, and McHea, 1978; Ram^ and Haaklns, 1981 ; Miller and lyer, 
1775), have been sumnarlssed hy Belsky and Steinberg (1978) and their 
potential isipacrt on poli<7 formulation (Federal Department of Health, 
Education and Velfare, 1978) has been clearly delineated regarding the • 
regulatory aspects of day care (Ruopp etal, 1979). Thiese studies attempted 
to determine the beneficial or deleterious effects of day care on children's 
development, but because these studies have been laboratory based they have 
been criticized (Bronfenbrenner etal, 1977; Etau^, 1980). 

IDiese initial studies have been followed by a series of day care 
studies to ascertain the inqiact of varying levels of day care quali*^ on 
dilldren's development (McCartney, 1984; McCartn^, Scarr, Phillips, Graj* 
4Schwarz, 1982; Clarke-Stewart, 1984; Howes 4 Rubensteln, 1985; Kontos ft 
Piene, 1985). These studies have been non-laboratory based utilizing a 
naturalistic and ecologically valid intervention strategy and have had an 
impact on proposed policy at the state and federal levels (Select Comnlttee 
on Children Youth ft Families, 1985). 

An issue that has not been addressed by these two sets of day care 
research and evaluation studies is how to develop an ongoing process of day 
care monitoring and evaluation. Attempts have been made in the past to 
hi^i^t exemplary state day care regalatory, monitoring and evaluation 
systems (Perrar et al, 1980; Bradley et al, 1984). However, it has only 
been recently that a child care regilatory, monitoring ft evaluation ^tems 
model, which was developed Toy a consortium of several states, holds promise 



as an effective and efficient means of ensuring day care prograjn compliance 
and quality (Piene and Nixon, 1985). 

This nev regilatory, monitoring and evaluation e^stems model (Child 
Care Indicator Checklist Statistical Model) has been extensively field 
tested in California, Pennsylvania, Michigan, West Virginia, Teras, Rev Toric 
City and Alberta, Canada, and has been used in several different human 
services: day care, child wlfare, and mental retardation services. This 
model is being proposed for use in North Carolina d^ care prograoB, is 
being pilot tested in twenty-four hour residential gro»q> care in 
Pennsylvania, and is being proposed for use in child protective services. 
The indicator checklist model has been demonstrated to be a cost effective 
and efficient method throu^ studies conducted in West Virginia. 

The model is based on a concept of Identiiying k^ indicators and 
predictors of program quality and regulatory compliance that have a positive 
impact on children's lives vrtiile tn out of home care. This indicator 
checklist model is based upon a statistical methodology that has been used 
in the test construction literature for some time (Piene, 1985) and is based 
on an emerging evaluative paradisa proposed by Cronbach (1982). 

The indicator checklist model is particularly relevant because of three" 
national developments regarding the role of government: 1 ) It has the 
potential of being a cost savings tool for states who will be suffering ft-om 
federal cut backs because of the Gramm-Rudman Deficit Reduction Act; 2) 
The Congressional Select Conmittee on Children Youth and Families has 
proposed legislation that clearly deals with the develOi^snt of child care 
regulatory and monitoring ^tems at the state level; and 3) The National 
Governor's Association is proposing an initiative for states to develop 



early childhood aonltoring and evaluation systeoa as an effective and 
efficient means for states to ensu^ the quality of child care services. 

Hhe chapter ly.Dr. Susan Kontos describes Pennsylvania's use of this 
indicator cheddist model in a research study dealing with the impact on 
children's development. The interested reader should consult the following 
articles and pubUcations (Piene and Nixon, igS5, 1985, 1981) for a more 
detailed description of the research and theoiy behind the indicator 
checklist model and the resultant child development program 
indicators/predictors (Piene, 1984). The following is a brief description 
of the historical development of the indicator checklist model and its 
implications for the future of child care delivery systems. 

The indicator checkUst model grew from research work conducted with 
Dr. Francis H. P&Lner in the early igTO's as a regional child developnent 
program evaluation model (Piene, 1975). This evaluation model was to be 
used at a state level to monitor the various levels of program quality in 
child day care. With the advent of the Federal Interagency Day Care 
Requirements Appropriateness Study (PIDCR) and the need for a monitoring 
tool to measure compliance with federal day care regulations, this Child 
Development Program Evaluation (CDPE) Model gained the attention of federal 
officials as a generic gyatens model for PIDCR compliance (Perrar, C-leaaon, 
and Smith, 1980; Bradl^ et al, 1984). 

This CDPE Model was supported by federal research and demonstration 
monies starting in late 1979. But before the project could get ofT the 
ground the PIDCR were pit into a state of abeyance or moratorium and the 
federal role shifted substantially to a state supported role with 
substantially fewer federal dollars. It was during this time period that 



two sifflif leant approaches developed to aUeviate the above problem: 1) a 
consortium of six states (Pennsylvania, California, West Virginia, Texas, 
Michigan, and Nev TorL— Children's Services Monitoring Transfer Consortium— 
(CEMC) was fomed to take on this nev state initiative for day care 
monitoring and 2) This Consortium proposed the indicator checklist model as 
a coat effective/efficient means for states to monitor and evaluate day care 
services in their respective states. 

The Oiildren's Services Monitoring Transfer Consortium (CSHC) conducted 
several siffiificact research studies utilizing this indicator checklist 
model that attempted to answer two questions: 1) Does compliance with state 
child care re^ilations have a positive impact on children? and 2) Are their 
predictors of program quality? 

There has been an attempt to identify the relationship between program 
qualily and compliance with state day care regolations, and child 
development outcomes. This has been addressed in several of the other 
chapters in this book. However, the relationship between program quality 
and program compliance which could gtve some direction to states' as th^ 
develop their day care regulatory and monitoring systems has not been 
addressed and was the focus of research of the CSMC. The results of this 
research is now presented. 

There has been an assumption in day care licensing that ftill compliance 
(100^ compliance) with state day care reguUtions is an indication of 
program quality. It has been hypothesized that as compliance increases with 
state day care regilations, a corresponding and equivalent increase in 
program quality will also occur- the more a program is in compliance, the 
bettor the program. 
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This F^thesia was not totally supported in the CSMC study. The data 
indicate that the centers with loW compliance scores (below ^ had the 
lowest program quality scores. This was expected and the results supported 
it. However, the centers that were in substantial compliance (^-90^) but 
not fUll ccmpUance (100!<) had the highest program quality scores, while 
those centers in full compliance (10Q5^) had lower program qualily scores. 
This was not expected. In other words, the worst programs had low 
compliance scores, but the fUlly coaqpliant programs were not the best 
programs (see Figure 1). A related and similar result has been identified 
in other children's services (Piene, 1965). 

Another significant result from this second set of analyses in the CSMC 
study was the identification of a series of regulatoiy and program quality 
items that correlated with the overall compliance (substantial compUance) 
and quality of the day care programs evaluated. These items can be grouped 
into the following generic categories: the day care program has an 
effective overall administrative structure; the day care program 
consistently implements the child development curriculum emphasizing the use 
of language, free play opportunities, and interest centers; and the day care, 
center administration emphasizes parental participation (see Figure 2). 

Prom a day care regulatory and monitoring point of view, these results 
could have an impact on public day care policy in the United States. It • 
implies that many states in the United States are supporting public day care 
policy that may not be as effective and efficient from a child care 
regulatory point of view, i.e. requiring day care centers to be in full 
compliance with state day care regulations. Mary state licensing 
departments have taken the position that day care centers in order to 
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Child SBvelopBeiit Cupriculwe-Progrm Ca^nneot 
oDjecxxyes nave tieen developed ty parents and staff. 
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C. Educational activities are provided for parents on an ongoing basis. 

Program Administration — Fiscal Component 
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and parerrra, hut is not overly restrictive. The prograi has an overalL 
program philosophy clearly stated xn program goals. ^ ^ 
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receive a day care license nust be in compliance with state day care 
re^ilations. This position has been supported by the research of Class and 
Orton (1960) who have been strong advocates of full compliance with 
regolations. 

An alternate approach for states in their development cf day care 
reffjlatoiy and monitoring eiystems is not to emphasize fu3I compliance bat 
rather substantial compliance with the predictor/indicator items identified 
in the Kontos & Piene (1985) study. Compliance with predictor or indicator 
items is the most efficient and effective means of ensuring program 
compliance and, ultimately, program qualiiy. The predictor or indicator 
items that were used in the Kontos ft Piene study were adult-child ratio, 
emergeo^y contact information on children, qualifications of the director, 
health ^raisals for children, and emphasis on day care activities that 
promote development of children's skills, and positive self identity/self 
esteem. It is alao significant to note that positive scores on children's 
social development assessments were related to higgler scores of compliance 
with these indicator items. The items that did not add substantially to the 
overall quality of a program were those administrative items where aU 
records had every item in compliance, such as, all eligibility/agreement 
forms completed at the time of a licensing visit. 

In addition to the above approach, social policymakers at the state &■ 
national levels should consider refocusing their emphasis from one of a 
strict regulatory stance to one that achieves a greater balance between day 
care re^ilations and regulations that deal with program content. A 
recommendation that wiU take the findings of the CSMC and the Kontos ft 
Piene studies and apply them directly to Day Care Regulatory ft Monitoring 
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gystems la the foUowing: states could develop and use an Indicator 
Checkliat along with a program qualily assessment instrument to assess day 
care centers, such as, the Early Childhood Environment Rating Scale (BCERS) 
or the Child Development Program Evaluation Scale (CDPB3). The CDPES is the 
result of the CSMC research study involving Penn^lvania, California, West 
Virginia, Michigan, New York with their respective indicator checklists. 
Bie CDPE^e items were the generic Indicators that consistently appeared 
on the respective states' indicator checklists at the program compliance and 
program quality levels. There Is also an 805«f agreement and overlap 
between the BCIRS (Hanns 4 Clifford, 1980) and the CDPES (Piene, 1984). ^ 
utilizing this model, states can continue to comply with their licensing 
mandate througji the use of their indicator checklist while at the same time 
increasing the quality of day care services with proper focusing on program 
content throu^ the use of the BCH?S, or the CDPE3. 

Two advantages of this model are readily apparent to pubUc policy 
makers: the indicator checklist approach can reduce the cost of monitoring 
and licensing day care centers and permit the more efficient reallocating 
and refocusing of staff resources in providing technical assistance and 
assessing program quality. The other advantage is that it substantially * 
reduces the burden on day care centers, especially those centers that have a 
record of high compliance and are judged suitable for use of the indicator 
checklist. In time analysis studies conducted in several states, 60^ 
savings in day care program monitoring time was realized througji the use of 
the indicator checklist. It would be proposed that these day care centers 
be Visited once every three years using the comprehensive ZJO Item CDP^ 
instrument. In the intervening years, the 15 Item Indicator Checklist would' 



c 



c 



c 

ERIC 



be used. Ihia aodel oould be a potential solution for states as they 
attempt to develop coet effective/efficient methods to deal with the Gram 
Rudman budget cuts. 

If states Ifflplenent above recooBendations of using the indicator 
checklist and program qualily assessment instrument model, they will have 
additional data in the ftiture to make sound resource allocation decisions 
regarding their day care poUqy based on a research data bank and not on 
capricious intuitions. In addition, these recoomiendations could have a very 
positive impact on the current state of the art in dey care regalatoiy and 
monitoring ^tems based on a review completed by Kendall and Walker 
(1985). In this review the authors point to the eroding effects of 
deregulation and the increasing cost to conduct licensing and monitoring 
visits. !lhe above day care regulatoiy and monitoring s«ystems model, which 
emplqya a continuous program monitoring information system with an 
evaluative component, could potentially alleviate some of these detrimental 
effects that have been occurring in the day care regiilatoiy field. 

It is particularly gratifying that in Pennsylvania's case, its day care 
regulatory and monitoring ^tem is accomplishing its intended purpose-to 
establish a baseline for quality and to ensure the health and safety of 
children while th^ attend day care. But there also appears to be an added 
benefit in tha^ Pennsylvania's regulatory system does have a beneficial 
impact on children's social development. Pennsylvania hopes that these 
recon«nendations and lotential revisions to its public day care policy will 
continue to protect the health and safety of young children w^iile ensuring 
the quality of child development programs. 

This model could also have a beneficial impart on child care delivery 
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^eus if the "Child Care Opportunities for Families Act" were to become 
law. The.~e would be the potential that the above model (Indicator Chedcliat 
Statistical Model) could blossom into a national child care regulatory, 
evaluation and monitoring system, rjmething a number of child care and child 
development experts have been advocating since the FIICR Appropriateness 
Study was completed (Select Comnittee on" Children Youth and Families, 
1985). If this could be accompUshed, it would appear to be a si^iificant 
advance in social polipy formulation and dsy care rc^,ulatory and monitoring 
^tems especially as Pennsylvania celebrates the 100th Anniversary of its 
Licensing law; and Head Start, at the national level, celebrates its 25th 
Anniversary. 
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